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Abstract. We study a new family of "classical" orthogonal polynomials, here 
called big -1 Jacobi polynomials, which satisfy (apart from a 3-term recur- 
rence relation) an eigenvalue problem with differential operators of Dunkl-type. 
These polynomials can be obtained from the big g-Jacobi polynomials in the 
limit q — > —1. An explicit expression of these polynomials in terms of Gauss' 
hypergeometric functions is found. The big -1 Jacobi polynomials are orthogo- 
nal on the union of two symmetric intervals of the real axis. We show that the 
big -1 Jacobi polynomials can be obtained from the Bannai-Ito polynomials 
when the orthogonality support is extended to an infinite number of points. 
We further indicate that these polynomials provide a nontrivial realization of 
the Askey- Wilson algebra for q — > — 1 . 



1. Introduction 

We constructed in [20] a system of "classical" orthogonal polynomials P n (x) 
containing two real parameters a, ft and corresponding to the limit q — >• — 1 of the 
little q- Jacobi polynomials. By "classical" we mean that these polynomials satisfy 
(apart from a 3-term recurrence relation) a nontrivial eigenvalue equation of the 
form 

(1.1) LP n {x) = X n P n (x). 

The novelty lies in the fact that L is a differential-difference operator of special type. 
Namely, L is a linear operator which is of first order in the derivative operator d x 
and contains also the reflection operator R which acts as Rf(x) — f(—x). Roughly 
speaking, one can say that L belongs to the class of Dunkl operators [8] which 
contain both the operators d x and R. Nevertheless, the operator L differs from the 
standard Dunkl operators in a fundamental way. Indeed, L preserves the linear 
space of polynomials of any given maximal degree. This basic property allows to 
construct a complete system of polynomials P n (x), n = 0, 1, 2, . . . as eigenfunctions 
of the operator L. 

Guided by the q — > — 1 limit of the little q- Jacobi polynomials, we derived in [20] 
an explicit expression of the polynomials P n {x) in terms of Gauss' hypergeometric 
functions. We also found explicitly the recurrence coefficients and showed that the 
polynomials P n {x) are orthogonal on the interval [—1,1] with a weight function 
related to the weight function of the generalized Jacobi polynomials [7] . We also 
proved that they admit the Dunkl classical property [5] and further demonstrated 
that the operator L together with the multiplication operator x form a special case 
of the Askey- Wilson algebra AW(3) [21] corresponding to the parameter q = — 1. 
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In this paper we construct similarly, a new family of " classical " orthogonal poly- 
nomials which are obtained as a nontrivial limit of the big q-Jacobi polynomials 
when q — > — 1. We will call them "big -1 Jacobi polynomials" 

In contrast to the little -1 Jacobi polynomials, the big -1 Jacobi polynomials 
contain 3 real parameters a, (3, c. This leads to more complicated formulas for the 
recurrence coefficients as well as for the explicit expression in terms of the Gauss 
hypergcometric function. Moreover, in contrast to the little -1 Jacobi polynomials 
the big -1 Jacobi polynomials are orthogonal on the union of the two intervals 
[— 1, — c] and [c, 1] (it is assumed that < c < 1). When c = these intervals 
connect into one interval [—1,1]. This corresponds to the degeneration of the big 
-1 Jacobi polynomials into the little -1 Jacobi polynomials 

The fundamental "classical" property (1.1) holds for the big -1 Jacobi polyno- 
mials as well. The operator L is again a first order differential operator of Dunkl 
type which preserves the space of polynomials. This means that both little and 
big -1 Jacobi polynomials provide two "missing" families of classical orthogonal 
polynomials which should be included into the Askey table as special cases. 

Limit cases q — > — 1 for q-ultraspherical polynomials were considered by Askey 
and Ismail [2] , [3] . Bannai and Ito found a nontrivial example of explicit polynomials 
corresponding to the limit q —¥ — 1 in the Askey scheme was proposed by [4], [19]. 
The Bannai-Ito polynomials arc orthogonal on a finite set of TV + 1 points. We 
show that the big -1 Jacobi polynomials are obtained in the limit N — > oo from the 
Bannai-Ito polynomials. 

We also demonstrate that the big -1 Jacobi polynomials provide a convenient 
realization of the AW (3) algebra for q = —1. 



2. Big q- Jacobi polynomials in the limit q = -1 

The big q- Jacobi polynomials P n {x;a,b,c) were introduced by W. Hahn [11] in 
1949. Andrews and Askey found explicit orthogonal relation for these polynomials 
in [1]. Implicitly, the big q- Jacobi polynomials are also contained in the Bannai-Ito 
scheme of dual systems of orthogonal polynomials as an infinite dimension analogue 
of the q-Racah polynomials [4]. These polynomials depend on 3 parameters a, b, c 
and are defined by the following 3-term recurrence relation (for brevity, we will 
sometimes omit the dependence on the parameters a,b,c): 

(2.1) P n +i{x) + b n P n (x) +u n P n _ 1 (x) =xP n (x), 

where 

u n — A n —iC n , b n — 1 — A n — C n 

with 
(2.2) 

_ (1 - qg"+ 1 )(l - abq^d - eg"* 1 ) _ n+1 (1 - g")(l - abc^q^jl - bq n ) 

(1 - abq 2n + l )(l - abq 2n + 2 ) ' " 009 (1 - a6g 2 "+ 1 )(l - abq 2n ) 

In terms of basic hypergeometric functions [13], [14] they are given by 

'q- n ,abq n+1 ,x 
aq, cq 



(2.3) P n (x;a,b,c) = K n3 (p 2 



<?;<7 



where the coefficient n n ensures that P n (x) is monic: P n (x) = x n + 0(x n x ). We 
shall not need the explicit expression of K n in the following. 
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The big q-Jacobi polynomials satisfy the eigenvalue equation [13], [14] 

(2.4) LP n {x) = X n P n {x), A n = (q~ n - 1)(1 - abq n+1 ) 
where the operator L is 

(2.5) Lf(x) = B(x)(f(xq) - f(x)) + D{x){f{xq- 1 ) - f(x)) 
with 

( 2 . 6) B(x) = aq{x - 1 f X - C \ D(x) = {X ~ aq) J? ~ CQ) 
The orthogonality relation is 

(2.7) / w(x)P n (x)P m (x)d q x = h n 6 nm , h n = u x u 2 . . .u n , 

J cq 

with the q-integral defined as [13], [14] 



r. 

J CO 



f{x)d q x = aq(l -q)^2 /«+ V - cq(l - q) ^ f(cq s+1 )q s 

,c 1 3=0 s=0 

and the weight function 

(2 8) w(x) = ^ lx ' q "> °^ c ~ lx ' q "l°° 

(x;q) 00 (bc- 1 x;q) 00 

where 

(a;q) s = (l-a)(l-a q )...(l-aq s - 1 ) 
is the shifted q-factorial [14] and (a; q)^ — lim s ^ 00 (a; q) s (In (2.8), g is a normal- 
ization factor which is not essential for our considerations). 

Consider the operator (q + 1)^ 1 L, where the operator L is defined by (2.5). Put 

(2.9) q = — exp(e), a — — exp(eo;), b — — cxp(e/3) 

and take the limit e — > which corresponds to the limit q — > — 1. It is not difficult 
to verify that the limit does exist and that we have 

(2.10) L = lim (q + l)- 1 L = g (x)(R-I)+g 1 (x)d x R, 
where 

, 011 , {a + (3 + l)x 2 + (eg -P)x + c 2(x-l){x + c) 

(2.11) g (x) = , gi(x) = — 



x 

The operator I is the identity operator and R is the reflection operator Rf(x) = 
/(-*)■ 

Equivalcntly, the operator L can be presented through its action on f(x): 

(2.12) L f(x) = g (x)(f(-x) - f(x)) - 9l (x)f'(-x) 

On monomials x n the operator L acts as follows. 
For n even, 

(2.13) L x n = An{x - l){x + c)x n ~ 2 . 
For n odd 

(2.14) L x n = -2(q + /3 + n + l)a; n + 2(/3 - ca + n - c)^ 1 " 1 + 2(n - l)cx n - 2 
In any case, the operator L is lower triangular, with 3 diagonals, in the basis x n : 

(2.15) Lx n = i n x n + ^ n x n - x + ( n x n - 2 
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with the coefficients £ n ,?7n,Cn straightforwardly obtained from (2.13), (2.14). It 
is easily seen that the operator Lo preserves the linear space of polynomials of 
any fixed dimension. Hence for every n = 0, 1, 2, . . . there are monic polynomials 
eigenfunctions P n l \x) — x n + 0{x n ^ 1 ) of the operator L a 

This eigenvalue equation is obtained as the q — > — 1 limit of the eigenvalue 
equation (2.4): 

(2.16) L Pi- 1 \x) = \ n p(- 1 \x), 

where 

2n, n even 
: + /3 + n+l), n odd 
Consider the limit q — > — 1 for the recurrence coefficients. Assuming (2.9), we have 

(2-18) ^ = ^A n =[^^: ^ ™ 



(2.17) X "={-2 ia - 



and 



e^O " (l- C )(a+ff + » + l) Qdd 

a+p+2n+2 ' 



(l-c)n 

A — n even 



(2 - 19) ^-a^- „ odd 

Hence for the recurrence coefficients we have 

(l-c) 2 n(a+/3+n) 



n even 



(2.20) = Y^A n _ x C n = { <°tfl 2r ?* I 



(a+/3+2n)2 



and 



(c-l)n , (l+e)(/3+n+l) 



C + a+/3+2n + a+£+2n+2 ' 71 eVen 



(2.21) = lim 1 - A n - C n - -, 

e-S-0 I r _l_ (l~c)(n+l) _ (c+l)(/3+n) 

l L ^ a+f3+2n+2 a+f3+2n ' " UUU 

The polynomials P„ *\x) satisfy the 3-term recurrence relation 

(2.22) P}-\\x) + b^P^ix) + ul-Vpt\\x) = xP^\x). 

For any real c ^ 1 and real a, (3 satisfying the restriction a > — 1,/3>— 1, the 
recurrence coefficients b n ^ are real and the recurrence coefficients u n are posi- 
tive. This means that the polynomials P„ X \x) are positive definite orthogonal 
polynomials. 

Let us consider expression (2.3) in details, 

(2.23) P n (x) = Kn ± ( %" ;g) ; ( ; &g "t 1; , g)s( ^S -, 

^ {q;q)s(aq;q)s(cq;q)s 

In the limit g — ^ — 1 it is easy to obtain that 

s/2 

(x;q) 



(cq; q), 



= < 



(l-cO 

1-x / 1-x 2 
1+c \ 1-c 2 



, s even 

( s -l)/2 



odd 



Hence, in the limit q — > — 1 the sum (2.23) is divided in two parts. The first part is 
an even polynomial with respect to x, i.e. p(x 2 ), where p(x) is a polynomial. The 
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second part will have the form (1 — x)q(x 2 ) with another polynomial q(x). Simple 
calculations lead to the following formulas. 

If n is even 
(2.24) 

P { n - 1) {x) = K n o.Fj i - .. r - — t I + 



n n+a+f3+2 
2 ' 2 
q+1 
2 



1 



1-C 2 



n(l — x) 
(l + c)(a + l) 



2-fl 



'in n+a+,3+2 
1 2 ' 2 
q+3 
2 



1-C 2 



If n is odd 
(2.25) 



2-f 1 



t-1 n+a+p+1 
2 ' 2 
q+1 
2 



1-C 2 



(q + /3 + n+ 1)(1 - a;) 
(l + c)(a + l) 



-2-r 1 



i-l ra+a+g+3 
2 ' 2 
q+3 
2 



1-C 2 



The normalization coefficient is given by 

(l-c 2 )"/ 2 ((q+l), 7: . 

(2.26) 



(1 + c) 



((n+q+/3+2)/2)„ /2 

(l- C 2)("-l)/2((q + l)/2) (tl + 1)/2 

((n+a+/3+l)/2) (n+1)/2 



n even 



n odd 



The remaining problem is to find the orthogonality relation and the corresponding 
weight function w{x) for the big -1 Jacobi polynomials. Of course, this could be 
done directly from the known orthogonality relation for the big q- Jacobi polyno- 
mials by taking the limit q — > — 1. However it is more instructive to derive the 
weight function using the method of polynomial mappings [10], [16]. This method 
will allow to find nontrivial relations between the big -1 Jacobi polynomials and the 
ordinary Jacobi polynomials. This will explain the origin of the rather "strange" 
expressions (2.24) and (2.25). 

3. Polynomial systems and the Christoffel transform 

In this section we consider a scheme allowing to obtain a new family of orthog- 
onal polynomial starting from two sets of orthogonal polynomials related by the 
Christoffel transform. This scheme is a simple generalization of the well known 
Chihara method for constructing symmetric orthogonal polynomials from a pair 
of orthogonal polynomials and their kernel partner [6] . It is also very close to the 
scheme proposed by Marcellan and Petronilho in [16]. 

Let P n (x), n = 0, 1, 2, . . . be a set of monic orthogonal polynomials satisfying 
the recurrence relation 

(3.1) P n +i(x) + b n P n (x) + u n P n -i(x) = xP n (x). 

Consider a partner family of orthogonal polynomials Q n (x) related to P n (x) by the 
Christoffel transform [17] 

Pn+l(x) — A n P n (x) 



(3.2) 



Qn(x) 



X — V 

,2\ in (,,2\ 



where v is a real parameter and A n = P n+ i(u )/P n {v ). 

If the polynomials P n (x) are monic orthogonal with respect to the linear func- 
tional a 

(a, P n (x)P rn (x)) =0, n/m 
then the polynomials Q n (x) are monic orthogonal with respect to the functional 
a = (x - v 2 )g, i.e. [17] 

(a, (x - v 2 )Q n {x)Q m (x)) = 0, n ^ m 
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The polynomials P n (x) are expressed in terms of the polynomials Q n {x) via the 
Geronimus transform [22] 

(3.3) P n (x) = Q n (x) - B n Q n -i(x), 

where the coefficients B n are related to A n and the recurrence coefficients by the 
formulas 

(3.4) U n = B n A n _ 1 , b n = - A n - B n + v 2 . 

Now, starting from a pair of polynomials P n (x),Q n (x) we can construct another 
family of orthogonal polynomial R n {x) by proceeding as follows. 

For even numbers n, let the polynomials R n {x) be defined according to 

(3.5) R 2n (x) = P n (x 2 ) 
and for odd numbers n, let 

(3.6) R 2n+1 {x) = {x - u)Q n {x 2 ) 

It is obvious that for all n = 0, 1, 2, . . . the polynomials R n {x) are monic polyno- 
mials in x of degree n. 

What is more important is that the polynomials R n {x) are orthogonal, since they 
satisfy the 3-term recurrence relation 

(3.7) R n +i(x) + (-l) n uR n (x) + v n R n -±{x) = xR n {x), 
where 

(3.8) v 2n = -B n , v 2n +i = -A n 

This construction can also be carried out in the reverse. 

Assume that the polynomials R n {x) satisfy the recurrence relation (3.7) with 
some real parameter v and positive coefficients v n , it can easily be shown by induc- 
tion that 

R 2n (x) = P n {x 2 ), R 2n +i(x) = (x - v)Q n (x 2 ), 

where P n (x) , Q n (x) are monic polynomials of degree n. 

The polynomials R n {x) are orthogonal with respect to a positive definite linear 
functional p: 

(3.9) (p, R n (x)R m (x)) =0, n ^ m 
Let 

r n = (p,x n ) 

be the corresponding moments. We use the standard normalization condition ro = 
1. It can then be proven, again by induction, that 

(3.10) r 2n+ i=vr 2n , n = 0,1,2,... 

and that the even moment r 2n is an even monic polynomial of degree 2n in the 
argument v, i.e. 

r 2n - u 2n + nv x v 2n - 2 + n{n 2 1) v 1 (v 1 + v 2 ) V 2n ^ + Oiv 2 ^). 

It is directly verified that the polynomials P n (x) and Q n (x) are orthogonal as they 
satisfy the recurrence relations 

P n +\{x) + (v 2n + v 2n+1 + v 2 )P n (x) + v 2n v 2n -\P n -i(x) = xP n (x) 



A LIMIT q = -1 FOR THE BIG Q-JACOBI POLYNOMIALS 



7 



and 



-l(ar) + (v 2n +2 + V2n+1 + V 2 )Qn(x) + V 2n V 2n+1 Q n -l(x) = xQ n (x) 



Moreover, the polynomials Q n (x) are Christoffel transforms of the polynomials 
P n (x): 

n , x _ Pn+l(x) +V 2n +lPn(x) 
X — V 1 

while the polynomials P n (x) are Geronimus transforms of Q n (x) : 

Pn(x) = Qn(x) + V 2n Qn-l(x) 

Assume that the polynomials P n (x) have moments c„. Then one has a simple 
relation between the moments 

(3.11) r 2n = c n , r 2n +i = vc n , n = 0,1,2,... 

The moments c„ corresponding to the polynomials Q n (x) are given by 

2 

m io( ~ c n+l ~ V C n 

(3.12) Cn = 5 

Ci — v z 

Expression (3.12) follows easily from the definition of the Christoffel transform [22]. 

Note that in the special case v = we recover the well known scheme relat- 
ing symmetric and non-symmetric polynomials that has been described in details 
by Chihara [6]. In this case the polynomials R n (x) are symmetric R n (—x) = 
(—l) n R n (x) and their odd moments are zero r 2n+ i = 0. All the above formulas 
remain valid if one puts v = 0. We have thus provided a generalization of the Chi- 
hara scheme with an additional parameter v. Note that the resulting polynomials 
R n (x) are no longer symmetric; they satisfy however the simple recurrence relation 
(3.7) and have properties very close to those of symmetric orthogonal polynomials. 

In [16] a more general problem was studied with the orthogonal polynomials 
R n (x) defined as R 2n {x) — P n (<j>{x)), where <f)(x) is a polynomial of second degree 
and P n (x) is a given system of orthogonal polynomials. Our approach corresponds 
to the special case <j>(x) — x 2 . Note that the general case of polynomial mapping has 
the form Rfj n (x) = P n (iTN{x)), where ttn(x) is a polynomial of degree N. Again it 
is assumed that both P n (x) and R n (x) are nondegenerate orthogonal polynomials. 
The theory of such mappings was considered in [10]. 

Consider now the following concrete example connected with Jacobi polynomi- 
als. This example will allow to establish the weight function of the big —1- Jacobi 
polynomials. 

Let 

be Jacobi polynomials with orthogonality relation 

[ ^(1 - x)"lfrt (x)P^) {x)dx = Km Snm 
Jo 



on the interval [0, 1]. 

The normalization coefficient 

(£ + !)„ 



G n = (-1)" 



ensures that P n {x) is monic P^' v \x) = x n + 0(x n ~ r ). 
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Perform first an affinc transformation of the argument and consider the new 
monic orthogonal polynomials 



where c is a real parameter with the restriction < c < 1. 
In terms of hypergeometric functions 

(3.13) P„(x) = (l-c) - — — — — r- 2-F1 



(n + e + v + i)n V f + 1 ' i - c ; 

Clearly, these polynomials are orthogonal on the interval [c 2 , 1] 

/ (l-a;) ? (a;-c 2 ) , 'P„(x)P m (x)dx = 0, n ^ to 
Introduce also the companion polynomials Q n (x) through the Christoffcl transform 

(3 . 14 ) OwW- ^'W-y-W , A,,-^' 1 ' 



1 ' " p„(l) 

It is easily seen that the polynomials Q n (x) are again expressible in terms of Jacobi 
polynomials with £ — > £ + 1: 



Q„(x) = (c 2 - 1)" 
or, in terms of hypergeometric functions 



1 



1-6 



2,n (C + 2)„ ^ f-n,n + £ + r, + 2^ 1 - a; 



(3.i5) c,M = (i-cT ( „ + — 2)n ^. v ? + 2 

The polynomials P n {x) and Q n (x) are connected by the relations (3.2) and (3.3) 
with v = 1. The coefficients A n and _B„ can be found from the following observation. 
Putting x = 1, we find from (3.13) and (3.15) 



p n (i) = (i - c 2 )" - - , g„(i) = (i-c 2 r 



(n + Z + T] + l)n {n + Z + r] + 2) r 

From these formulas we immediately get 

(3.16) A„ = %iil = (l- C 2 ) K + " + m + V + n+l) 



P„(l) v 7 (2n + £ + »? + l)(2n + £ + »? + 2) 
and 

p _ Q n (l)-P n (l) 2 nfa + n) 

1 J "~ Qn-i(l) 1 Cj (2n + C + ?? )(2n + e + r ? + l)- 

Note that A„ > 0, £?„ > for n = 1, 2, . . . due to the restriction < c < 1. 

Consider now the new monic orthogonal polynomials R n (x) defined by the rela- 
tions 

(3.18) R 2n (x) = P n {x 2 ), R 2n+1 (x) =(x- l)Q n (x 2 ) 

According to the general theory of polynomial mappings [10], [16], it is not difficult 
to show that the polynomials R n (x) are orthogonal on a domain formed by the 
union of two intervals [— 1, — c], [c, 1] of the real axis: 

(3.19) J R n (x)R m (x)W(x)dx + R n (x)R m (x)W(x)dx = 0, n ^ to 
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where the (non-normalized) weight function is: 

(3.20) W(x) = 9(x)(l + x)(l - x 2 )t(x 2 - c 2 )" 

and 9{x) = x/\x\ is the sign function. Note that the weight function W(x) is not 
positive on the interval [— 1, — c]. 

In terms of Gauss' hypergeometric functions we have the expressions 
(3.21) 

R2n(X) = P n {X ) = (1 - C ) - — - | — - 2 F\ ' 



and 
(3.22) 



2, n (C + 2)„ „ „ {-n,n + Z + V + 2^ 1 



i? 2n+ i(x) = (x-l)Q„(^) = ^— (a:-l)2Fi , 

(n + 4+r7 + 2) n V 4 + 2 

The polynomials R n (x) satisfy the 3-term recurrence relation 

(3.23) Rn+i(x) + (-l) n R n (x)+v n R n - 1 (x) = xR n (x), 

where 
(3.24) 

o ,2 n gfa + ") 4 ,„ 2 ,x (? + n + l)(e + r/ + n+l) 

V2n = ~B n = (C — — rjT. — — — T, W2n+1 = ~A n = (c -1)- 



(2n + ^ + r ? )(2n + e + r? + l)' v 7 (2n + £ + r? + l)(2n + £ + »J + 2) 

Note that all the coefficients u„ are negative, v n < 0, which corresponds to the 
non-positivity of the weight function W(x). 

4. The weight function and the orthogonality of the big -1 Jacobi 

polynomials 

In order to determine the weight function and the orthogonality region for the big 
-1 Jacobi polynomials, we notice that formulas (2.24) and (2.25) can be presented 
in the following equivalent form: 

(4.1) Pt 1} (*) = RnW - G n Rn-i(x), 

where R n {x) are the polynomials defined by (3.21), (3.22) that satisfy the recurrence 
relation (3.23). In these formulas we should put £ = {a — l)/2, f] = (f3 + l)/2. The 
coefficients G n have the expression 

( (l-c)ra 

(4.2) G n = 



n even 



2n+a+f) ' 

■ (1 2 +C | (w ^ a) , n odd 



It is well known that if two families of orthogonal polynomials are related by a 
formula such as (4.1), then necessarily the polynomials Pn~ 1 \x) are obtained from 
the polynomials R n {x) by the Geronimus transform [22]. This is equivalent to 
the statement that the weight function w ( -~ 1 \x) of the polynomials P^ 1 \x) is 
obtained from the weight function W(x) of the polynomials R n (x) as follows: 

(4.3) (x) = + MS(x - n), 

with two additional parameters /x and M . Formula (4.3) means that apart from the 
division of the weight function W{x) by the linear factor x — \i there is an additional 
concentrated mass M that is inserted at the point x = fi. 
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The parameter \i can be found from the recurrence relation for the coefficients 
G„ [22] 

(4-4) G n+1 + (-l)" + 

with the recurrence coefficients v n given by (3.24). 
Substituting (4.2) into (4.4) we obtain /j, = —c. 

Thus the orthogonality relation for polynomials P„ ^ (x) takes the form 
(4.5) 

P { n - 1) {x)Pl; 1 \x)W{x){x + c^dx + MP^{-c)P^(-c) = 0, n ± m 



ir 

where the contour T is the union of the two intervals [—1, — c] and [c, 1] of the real 
axis. 

In order to find the value M of the concentrated mass it is sufficient to consider 
a special case of the orthogonality relation (4.5) for n = 1, m = 

(4.6) J P ( f 1 \x)W{x){x + c)- 1 dx + MP 1 {-c) = Q 
Now, P[~ 1 \x) is given by 

P[~ 1 \x)=x + C 

where £ = c ^ a 2 t ^~^~ 1 . Substituting this expression into (4.6) and calculating the 
integral (through an elementary reduction to the Euler beta-integral) we find that 
M = 0. 

Thus, the orthogonality relation for polynomials Pn~ 1 \x) reads 

(4.7) J p(-V{x)P^(x)w(-V(x)dx = 0, n^m, 

where the weight function w ( ~~ 1 \x) can be presented in the form 

(4.8) w^ix) = 9(x)(x + l)(x + c)-\l - x 2 )^-^' 2 {x 2 - c 2 )^ 1 )/ 2 
or, equivalently 

(4.9) w^(x) = 9(x)(x + l)(x - c)(l - x 2 ) {a -^/ 2 {x 2 - c 2 )^" 1 ^ 2 . 

Note that under the restrictions a > —1,0 > — 1, the weight function is positive 
on the two intervals of T and all the moments 



= J w { - 1 \x)x n i 



n>„ = I w ( ' ] \ r).r"d.r 

are finite for n = 0, 1, 2, 

When c — > 0, the big q-Jacobi polynomials reduce to the little q-Jacobi poly- 
nomials [13]. In the limit case q — > — 1 we see that when c — > 0, the set of two 
intervals coalesces to the single interval [—1,1] and the weight function becomes 

tu(a;)|c=o =(l + x)\xf{l-x 2 f a -^l 2 

which corresponds to the weight function of the little — 1 Jacobi polynomials [20] . 

So far, we considered the case < c < 0. The case c > 1 can be treated in an 
analogous way. This leads to the following orthogonality relation 
(4.10) 

J P^ 1 \x)P^ 1 \x)w { - 1) {x)dx+ p(- 1 \x)p(- 1 \x)w^- 1 \x)dx = Q, n^m, 
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where the weight function is almost the same as in (4.9) with obvious modifications: 

(4.11) w^Hx) = 9(x)(x + l)(c - x)(x 2 - l)^" 1 )/ 2 ^ 2 - x 2 )^- 1)/2 

and where again we have the restrictions a > — 1, /3 > — 1. 

The case c = 1 is degenerate: the recurrence coefficients u„ for even n become 
zero, ii2„ = 0, which means that orthogonal polynomials P„ (x) are no more 
positive definite. The two intervals of orthogonality shrink into two points x = ±1. 



5. The big -1 Jacobi polynomials as limits of the Bannai-Ito 

polynomials 

Bannai and Ito proved a theorem which characterizes all dual polynomial schemes 
[4]. This theorem is a generalization of the Leonard theorem [15], where only the 
finite-dimensional case was considered. Apart from the already known explicit 
orthogonal polynomials from the Askey scheme, Bannai and Ito found one more 
example corresponding to the limit q — > — 1 of the q-Racah polynomials. The 
Bannai-Ito polynomials W n (x) are orthogonal on a finite number of points Xi, i = 
0,1, 2,..., AT given by 

2hi, i even 
2h(i + 1 - s), i odd ' 

where 9o,h,s are arbitrary parameters. 

The Bannai-Ito polynomials satisfy the recurrence relation [4], [19] 

(5.2) A n W n+1 (x) + (9 -A n - C n )W n (x) + C n W n -i(x) = xW n (x), 



2h(n+l+r 1 )(n+l+r a ) 
2n+2 — s* 

2Mn + l-,-)(n+l-r 3 ) odd 
2n+2 — s* 



2hn(n — s*-\-rs) 
S 71 eVen 

2ft(n-ri-a-)(n-r2-a*) 



where 

(5.3) A„ 
and 

(5.4) C n = 

{ 2n- 

where s* , r 1; r 2 are parameters such that 

(5.5) s + s* = r% — n - r 2 

and r 2 = — iV — 1 if TV is even and rs = N + 1 if N is odd. 

The polynomials W n (i) are not monic. Instead, they satisfy the conditions [4] 
W n (9o) = 1, n = 0, 1, 2, . . . , N. As usual, it is assumed that W-\{x) = 0. We can 
introduce the monic Bannai-Ito polynomials W n {x) = x n + 0(x n ~ 1 ) by the formula 

W n (x) = A A 1 . . . A n ^W n (x). 

The polynomials W n {x) are then seen to satisfy the recurrence relation 

(5.6) W n+1 (x) + (6 Q - A n - C n )W n (x) + A n ^C n W n ^(x) = xW n (x). 

Note that the parameter 9o is not essential: it only specifies the initial point xq. 
We can thus put 9 — 1 without loss of generality The recurrence relation (5.6) 
then determines all polynomials W n {x) uniquely. 
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Consider now a limit N — > oo. Given the relations that r 2 and r 3 have with N, it 
is clear that under such a limit, we must necessarily have: r 3 — > oo and r 2 — > — oo. 
We assume that the parameters n, s* are finite. It is now convenient to put 

ri = a, s* = —a — j3 

with some fixed parameters a, /3. 

From (5.5) it then follows that s — > oo. The parameter h moreover, is free: it 
allows for a scaling of the argument x. We can thus choose h — >• in such a way 
that 

(5.7) 2/w 2 ->-c+l, 2/w 3 ->c-l, 

where c is a parameter such that < c < 1. 

Then, in the limit N — > oo, the recurrence coefficients A„ and C„ coincide with 
the coefficients A n ,C n given by formulas (2.18) and (2.19), and we have already 
observed that these coefficients A n and C n determine uniquely the big -1 Jacobi 
polynomials. 

Consider the behavior of the argument xt in the limit TV — > oo. As h — »• 0, let 
i — > oo in a way such that 2hi — > —y, where y is a continuous variable which varies 
from to c. Hence from (5.1), in the limit N — > oo, the points Xi, for even i, 
densely cover the interval [c, 1]. Similarly, from (5.5), (5.7) 

lim 2hs = lim {2hr 3 - 2hr 2 \ = -2 

N^oo N^oo 

and hence from (5.1), in the limit TV — > oo, the points Xi, for odd i, densely cover the 
interval [—1, — c]. This corresponds to the fact that the big -1 Jacobi polynomials 
are orthogonal on the union of the two intervals [— 1, — c] and [c, 1]. 

We thus have shown that the big -1 Jacobi polynomials can be obtained from 
the Bannai-Ito polynomials W n {x) through a limit process where N — > oo. This 
complements the fact demonstrated in this paper that the big -1 Jacobi polynomials 
arise as a q — >• — 1 limit from the big q- Jacobi polynomials. 

When wc remind ourselves that the big q- Jacobi polynomial result from a N — > 
oo limit of the q-Racah polynomials [13], we see that we have the following com- 
mutative diagram for limit relations between these polynomials: 



q-Racah 


9-> 1 




1— >oo 







Bannai-Ito 



AT->oo 



Big q- Jacobi 



q-y-l 



Big -1 Jacobi 



6. Anticommutator algebra describing big -1 Jacobi polynomials 

The Askey- Wilson polynomials are described by the AW(3)-algebra [21], [18]. 
Among the different equivalent forms of this algebra, we choose the following one: 

(6.1) XY-qYX = fi 3 Z+w 3 , YZ-qZY = mX+wi, ZX -qX Z = fi 2 Y +uj 2 , 

which possesses an obvious symmetry with respect to all 3 operators (see, e.g. [12]). 
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Here q is a fixed parameter corresponding to the "base" parameter in the q- 
hypcrgcomctric functions defining the Askey- Wilson polynomials [13]. The pairs of 
operators (X,Y), (Y,Z) and (Z,X) play the role of " Leonard pairs" (see [18], [12]). 

The Casimir operator 

(6.2) Q = (q 2 - l)XYZ + mX 2 + fi 2 q 2 Y 2 + fx 3 Z 2 + {q+ l)(wiX + uj 2 qY + w 3 Z) 

commutes with all operators X, Y, Z. 

The constants u>j, i — 1,2,2 (together with the value of the Casimir operator Q) 
define representations of the AM^(3) algebra (see [21] for details). 

Consider now the case of the big —1 Jacobi polynomials and choose the following 
operators 

2 

(6.3) X = L + a + P + l, Y = x, Z= — (c + (x - l)(x + c)R) , 

x 

where L is the operator given by (2.10). 

It is then easy to verify that these operators satisfy the linear anticommutation 
relations 

(6.4) XY + YX = Z + lu 3 , YZ + ZY = ui, ZX + X Z = 4Y + lj 2 , 
where 

coi = —4c, uj 2 = 4(a — /3c), cj 3 = 2((3 — ac). 
The Casimir operator of the algebra defined by (6.4) is 

Q = Z 2 + AY 2 

In the realization (6.3) the Casimir operator takes the constant value Q = 4(c 2 + 1). 

In this realization the operator X (up to an additive constant) is the operator 
of which the polynomials P^T 1 \x) are the eigenfunctions. The operator Y here 
corresponds to multiplication by x. 

The "dual" realization of the algebra (6.4) is obtained if one takes an infinite 
discrete basis e n , n = 0, 1, 2, . . . on which the operators X, Y act as 

(6.5) Xe n = (A„ + a + /3 + l)e„, Ye n = t^+V e„+i + &i _1) e„ + e„_i, 

where A„ is the eigenvalue (2.17) and where the recurrence coefficients u„ 1 \ bn ^ 
are given by (2.20), (2.21). Thus in this representation the operator Y is a Jacobi 
(i.e. tri-diagonal) matrix and the eigenvalue equation 

YP = xP 

is equivalent to the recurrence relation (2.22) for the big —1 Jacobi polynomials. 
Indeed, we can present the vector P in terms of its expansion coefficients over the 
basis e„: 

oo 

P = y ' C n e„ 

n=0 

Without loss of generality we can choose Co = 1. The coefficients C n in this 
expansion are then found to satisfy the recurrence relation (2.22) and it is seen 
moreover that these C n are monic polynomials in x of degree n. Hence C' n — 
Pt 1} (x). 
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7. Two-diagonal basis for the operator L and a generalization of 
Gauss' hypergeometric functions 

We already showed that the Dunkl-type operator Lo is tri-diagonal in the or- 
dinary monomial basis x n (see formula (2.15)). There exists, however, another 
polynomial basis in which the operator L is two-diagonal. This basis can be con- 
structed as follows 
(7.1) 

cf)Q = l,0i (a;) = x-l,(f> 2 (x) = (x 2 -l) 1 ...,(j)2n(x) = {x 2 -l) n , (t) 2n +i(x) = {x-l)(x 2 - 
It is easily verified that 

(7.2) L <j)n(x) = X n (j) n (x) + r] n 4> n - 1 (x) , 
where A„ is the eigenvalue given by by (2.17), and 

2n(c — 1), if n even 
-2(c+l)(a + n) if n odd 
Consider now the eigenvalue equation 

(7.3) L P n (x) = X n P n (x) 
and expand the polynomials P n {x) over the basis 4> n {x): 

n 

P n(x) = ^2 A ns4>s{x). 
s=0 

For the expansion coefficients A ns we have from (7.3): 

(7.4) A n . s+1 = ^ (A "' A - } 

Vs+l 

From (7.4), the coefficients A ns can be found explicitly in terms of A n0 : 

(A„ — Aq)(A„ — Ai) . . . (A„ — A s _i) 



Vn = 



(7.5) A ns = A n0 

or in terms of the cocfficic 

(7.6) A ns = A % 



mm ■■■Vs 

or in terms of the coefficient A nn : 

VnVn-l ■ ■■Vs+l 



(A„ — A„_i)(A„ — A„_2) • • • (A n — A s ) 

We thus have the following explicit formula for the polynomials P n (x) 
(7.7) P n {x) = A n0 V (^-^)(X n -X 1 )...(X n -X s ^) Mx) 

Expression (7.7) resembles Gauss' hypergeometric function and can be considered 
as a nontrivial generalization of it. Indeed, products in the numerator and denom- 
inator of (7.7) can easily be presented in terms of ordinary Pochhammer symbols 
and we thus recover the explicit formulas (2.24) and (2.25). Note nevertheless, that 
the form (7.7) looks much simpler. 

Moreover, note also that in the basis <pn(x) the operators X and Y of the algebra 
defined by (6.3) and (6.4), become lower and upper triangular: 

Xcj) n {x) = (L + a + fj + l)(/>n(x) = {X n + a + 13 + l)<f> n (x) + r) n (j) n -i{x) 

and 

Y(p n (x) = X(p n (x) = 4>n+l{x) + (-l) n (p n (x) 
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Note that such bases in which the operators X, Y arc two-diagonal, were central 
objects in Terwilliger's approach to Leonard pairs [18], [19]. Formulas similar to 
(7.7) also appear in the theory of Leonard pairs. 
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